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A group-theoretical connection between horizontal symmetry Q and fermion mixing is 
established, and applied to neutrino mixing. The group-theoretical approach is consistent 
with a dynamical theory based on 1/(1) X Q, but the dynamical theory can be used to 
pick out the most stable mixing that purely group-theoretical considerations cannot. A 
symmetry common to leptons and quarks is also discussed. This higher symmetry picks 
A4 over S4 to be the preferred symmetry for leptons. 



1. Introduction 

When neutron was discovered by Chadwick in 1932, Heisenberg came up with a 
new quantum number, the isotopic spin, to distinguish it from the proton. The 
associated Noether symmetry SU (2) valid for strong interactions tells us that their 
nuclear forces are essentially the same. Now that we have three generations of quarks 
and three generation of leptons, all with the same Standard Model interactions, it 
seems natural that there would be a new quantum number and a new symmetry 
for them. This hypothetical symmetry is known as a horizontal symmetry, a family 
symmetry, or a generation symmetry. 

Unlike protons and neutrons, which have nearly the same mass, the masses of the 
three generations of fermions are vastly different. Moreover, they mix. This suggests 
that if a horizontal symmetry exists, it has to be severely broken, presumably spon- 
taneously, a fact which makes the identification of symmetry very difficult. There 
is however hope if the breaking leaves behind some unbroken residual symmetry 
that can be traced. In that case, group property of the symmetry can be invoked 
to reconstruct the unbroken horizontal symmetry from the residual symmetry. 

We will show in the next section that residual symmetries are present and located 
in the mixing matrix. In the case when neutrino mixing is given by the tribimaximal 
mixing matrixf^ the minimal horizontal symmetry group so obtained is S4, the 
permutation group of four objects. 



2. Group Theory of Mixing 

In this section we show how mixing determines the residual symmetry, and from 
there the horizontal symmetry. We also show how mixing can be obtained from a 
given horizontal group, using only symmetry arguments with no dynamical input. 
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We will concentrate on leptonic mixing which produces a finite non-abelian sym- 
metry group. The same procedure can in principle be used to study quark mixing, 
but no symmetry smaller than SU(3) is obtained in that way. For more details of 
this approach, see Refs. [2] to [4]. 

Let M e be the charged-lepton mass matrix, M v the neutrino Dirac mass ma- 
trix, and Mr the heavy Majorana mass matrix in a type-I seesaw model. Since a 
mixing matrix refers to the mixing of left-handed fermions, we can eliminate any 
reference to the right-handed fermions by considering the effective mass matrices 
M e = M\M e = ~m\ for charged lcptons, and M^ = M V M^M V = for neu- 
trinos, which connect only left-handed fermions with one another. The fact that 
M v is a symmetric rather than hermitian like M e is a reflection that neutrinos are 
(assumed to be) Majorana particles. 

The PMNS neutrino mixing matrix U is the matrix that renders U T M U U diag- 
onal in the basis where M e is diagonal. 

Suppose F is a symmetry for left-handed charged-leptons and G a symmetry for 
left-handed neutrinos. That means, F, G are unitary matrices obeying F^M e F — 
M e and G T M U G = M v . We shall assume both of them to have a unit determinant so 
that they belong to SU(3). It can be shown from the Majorana character M v = M v 
that G 2 = 1. That means G has two —1 eigenvalues and one +1 eigenvalues. As 
a result, whatever the PMNS mixing matrix U is, there are exactly three residual 
symmetry operators G given by 

Gi = f7diag(l, -1, -l)U\ G 2 = f7diag(-l, 1, -l)U\ G 3 = f7diag(-l, -1, l)U\ 

It is easy to see that the product of any two of them equals to the third, so they 
are the non-unit elements of an abstract Z 2 x Z 2 group. 

The residual symmetry F in the charged-lepton sector is different. Since M e is 
diagonal and non-degenerate, all that is required is for F to be diagonal and unitary. 
It can satisfy F n = 1 for any n. We would however limit it to non-degenerate 
matrices, with three distinct eigenvalues, so that in the basis where F is diagonal, 
M e is forced to be diagonal as well. In principle there are still an infinite number of 
these symmetry operators, forming an abstract group which is the direct product 
of any number of cyclic groups. 

2.1. From U to Q 

Any group Q generated by Gi,G 2 ,G 3 and at least one F is a possible horizontal 
symmetry group of the left-handed fermions from which mixing U can be obtained. 
The broken symmetries are those elements in Q not equal to F and Gi . If we want 
Q to be minimal, we pick only one F, and the smallest possible F at that. That 
would be F = diag(l, 0, 2 ) := F 3 where = e 27 ™/ 3 . 

We will use the symbol {X\,X 2 , - ■ ■ ,X m } to denote the group generated by 
the matrices X\ to X n . In that notation, the horizontal symmetry group is Q = 
{F, Gi,G 2 , G 3 }. 
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There are a few general things we can say about Q. To have a non-trivial mixing, 
Gi must not be diagonal when F is, hence Q is a non-abelian group. Since it contains 
a subgroup generated by the Gj's, its order must be a multiple of 4. Moreover, for 
almost all U's, the order of the group Q would turn out to be infinite; the symmetry 
operators G\, G 2 , G3 have to be just right to produce a finite group Q. One of these 
very special Ws turns out to be the tribimaximal mixing matrix discussed below. 

Let us now apply this general formalism to neutrino mixing observed experi- 
mentally. To within one standard deviation, the mixing matrix is consistent with 
the 'tribimaximal matrix' (TBM) 1 

1 ( 2 V2 \ 
Utbm = -7= -1 V2 V3 , (1) 
V6 V-lv^-V3/ 
whose mixing angles 8ij and CP phase 6 are given by 

P:= (sme 12 ,sm9 23l sme 13 e- lS ) = (-1,-1,0}. (2) 

The residual symmetries Gi derived from this U are 

II -2-2\ /-I 2 2\ /10 0\ 

Gi = - -2 -2 1 , G 2 = - 2 -1 2 , G 3 = - 1 . (3) 
d V-2 1 -2/ ^ V 2 2 -1/ \0 1 0/ 

Defining an invariant eigenvector to be an eigenvector with eigenvalue +1. (|3[) sim- 
ply says that the normalized invariant eigenvector of Gi is the ith column of the 
mixing matrix U. Thus in the case of TBM, G3 is responsible for bimaximal mixing 
in the third column of Utbm, and G 2 is responsible for trimaximal mixing in the 
second column. 

Choosing F = diag(l,0, 2 ) := F3 to be the residual symmetry in the charged- 
lepton sector, the horizontal symmetry group generated by F and the these three 
Gi's turns out to be the symmetric group 15*4. 

If F is not given by F3, then the group Q is not S4. However, it can be shown 
that as long as Q is a finite subgroup of SU (3), it always contains S4 as a subgroupP 

Let us look at another example to further illustrate the general procedure. This 
example is unphysical, for its mixing angles and CP phase (see ([2]) for definition) are 
P = (-^j e ), far from the experimental values. Nevertheless, this example 
is useful in illustrating a couple of other things. 

The mixing matrix in this example is 




U C w = -7= 1 2 , (4) 



and the resulting residual symmetries Gi computed from Ucw are 

f-1 20 20 2 \ /-l 2 2 \ /-l 20 2 20 1 

G[ = - 2 2 -1 20 , G 2 - - 2 -1 2 , = - 20 -1 2 2 I . (5) 
d \ 20 20 2 -l/ 6 \2 2-1/ d \20 2 20 -1 
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Note that G2 is identical in ^ and §5§, but G\ and G3 are different, so a prime 
is put in (T5J) to tell them apart. The group Q — {F 3 , G[, G2, G 3 } is now A4, the 
subgroup of S4 consisting of even permutations of four objects. 

It turns out that {F3, Gi} is already S4 and {F 3 , G2} is already A4. The physical 
significance of this observation is explained below. 

Remember that the normalized invariant eigenvector of Gi is the ith column of 
the mixing matrix U. If Gi is given, then the second column of U is fixed. The 
symmetry group Q of U depends on what we choose for the first and third columns, 
equivalently, what G% and G3 are. Most of the time the resulting group Q is very 
large, of infinite order. If we look at the other end of the spectrum, and ask how can 
they be chosen so that the resulting group Q is the smallest, namely A4 = {F3, G2}, 
then the answer is that they must be G[ and G 3 of ([5]). If we ask how can they 
be chosen to obtain the next smallest group, namely S4, then the answer is Gi 
and G3 of ((3|). Similarly, if the first column of the TBM matrix is given, then the 
smallest group Q — S4 is obtained by choosing the second and third columns of U 
to be those of TBM. We can get a larger group, such as S5, by choosing these two 
columns differently, but most of the time we will end up with a group of infinite 
order for a random choice of these two columns. 

2.2. From Q to U 

So far we have discussed how to obtain the unbroken horizontal symmetry group 
Q from a mixing matrix U. The connection also works in the opposite direction, 
getting U from a given Q. This can be done in the following wayP 

First, identify all possible pairs of mutually commuting order-2 elements in Q . 
These would be candidates for Gi and G2, with G3 given by G3 = G1G2. Next, pick 
a F from any other element with an order > 3, provided its eigenvalues are non- 
degenerate. Go to a 3-dimensional irreducible representation in which det(Gi) = +1, 
in the basis where F is diagonal. Pick out the invariant eigenvectors u\, 2x2,1*3 of 
Gi , G2 , G3 respectively. Then the three columns of the mixing matrix U are simply 
ui, U2, and M3. 

It is clear that there is no way for group theory to tell which column is which, and 
similarly which row is which. Hence the U determined this way is unique only up 
to possible re-shuffling of rows and columns. Moreover, since the Majorana phases 
are not presently known, we can identify two U's differed only by row and column 
phases. We will consider two U's equivalent if they differ only by row and column 
phases, and row and column re-shuffling. 

One might think that there are so many ways to choose the pair (Gi, G2) and 
the element F, that the number of U's emerging would be so large to become 
unmanageable. It turns out that this is not the case as most of them are equivalent, 
leaving behind only very few inequivalent ones, at least for small groups. For Q = A4, 
the only inequivalent mixing is given by (j3J. For S4, there are two inequivalent 
mixings, given by the TBM in and another one with P = (4=, -7=, 0). For A 5 , 
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there are again only 2 inequivalent ones. For more detail, please see Ref. [3]. 

Sometimes we refer to this kind of mixing as full mixing, to distinguish it from 
a partial mixing, formed by one order-2 element G and one order > 3 element F 
picked from Q, with a second order-2 operator G' commuting with this G picked 
arbitrarily, not necessarily from the group. If Q = {F, G}, then Q' — {F, G,G'} D G. 
If no adjective is attached, then mixing means full mixing. For example, TBM can 
be obtained as a full mixing of S±, or a partial mixing of A4. 

3. Dynamical Theory of Mixing 

So far everything is derived from group-theoretical considerations, without any dy- 
namical input. What would we gain by incorporating dynamics into consideration? 
And, what kind of dynamics should we impose? 

Let me discuss the second question first. The dynamics should of course be in- 
variant under the symmetry group Q . We would also like the mixings derived from it 
to retain some memory of the group, namely, to have at least one residual symmetry 
each to be a member of Q ', both in the charged-lepton sector and the neutrino sector. 
In other words, we would like the mixings deduced from the dynamics to be full or 
partial mixings of Q . There is no a priori guarantee that such a dynamics exists, 
but for many groups including A4 and S4, the dynamics can indeed be obtained by 
imposing an additional U(l) symmetry, as we shall discuss in the second subsection 
below. 

To implement this objective we must first figure out how to impose a residual 
symmetry in a dynamical theory. That will be discussed in the first subsection below. 
Now the first question. With dynamics different mixings have different energies, so 
dynamics provides a mechanism to pick out the preferred inequivalent or partial 
mixing that has the lowest energy among them. 

If dynamics can pick out a preferred mixing (or residual symmetries) from a 
group Q, then in a similar way it might be able to pick out a preferred group Q from 
a larger group. This possibility is discussed in the third subsection below. 

The lack of time prevents me from discussing any of these in great detail, so I will 
only summarize the results here, and refer the interesting readers to the published 
literature 

3.1. Vacuum alignment 

A dynamical theory starts from a Lagrangian invariant under s horizontal symme- 
try group Q . Mass matrices from which mixing is derived come from the Yukawa 
interactions after symmetry is broken spontaneously. The Higgs fields in the Yukawa 
terms carry Standard Model (SM) quantum numbers and Q quantum numbers. For 
simplicity we shall assume them to be compound fields, made up of products of the 
usual SM Higgs fields and valon fields carrying horizontal {Q) quantum numbers. 
The SM Higgs fields are horizontal singlets, and the horizontal valon fields are SM 
singlets. This allows us to consider horizontal symmetry separately from the known 



January 25, 2013 19:10 



WSPC - Proceedings Trim Size: 9.75in x 6.5in winllproc 



6 

SM symmetries. 

The original Lagrangian is invariant under Q, hence if we carry out a simul- 
taneous (^-transformation of the left-handed fermions, the right-handed fermions, 
and the valons, then every Yukawa term remains unchanged. This is no longer true 
when the valons acquire expectation values, thereby breaking Q. However, if the 
valon expectation value is an invariant eigenvector of some g £ Q 1 then the Yukawa 
terms containing this valon would remain invariant under g. Therefore, if is a 
valon field in the charged-lepton sector such that F(<f>) — (</)), then F is a residual 
symmetry of the charged lepton mass matrix M e . Similarly, if % is a valon field in 
the neutrino sector such that Gi (x) = (x) i then G$ is a residual symmetry of the 
neutrino mass matrices M„ and Mr. If this (x) is the same for all three i, then the 
mixing computed from it is a full mixing. If it is different for different i, then the 
mixing computed from it is a partial mixing. In that case full mixing is obtained by 
taking (x) = 0, the only common invariant vector of all the G^s. 

In order to have enough tunable parameters to fit the masses, the original La- 
grangian usually contains valons belonging to all the irreducible representations of 
Q. The condition above that expectation values are invariant eigenvectors must be 
true in all irreducible representations. In case such an invariant eigenvector does 
not exist in some representation, then the expectation value should be taken to be 
zero because a zero vector is always an invariant vector. 

For illustrations and more details, see Ref. [2]. 

3.2. Valon dynamics of U(l) X Q 

Expectation values are taken from the stationary points of a valon potential. Ac- 
cording to the last subsection, in order for the potential to produce only full and 
partial mixings of Q, these points have to be invariant eigenvectors in every irre- 
ducible representation. 

We will use Q — A4 to sketch out what is involved. For detailed discussions and 
for other groups G, see Ref. [3]. 

There are four irreducible representations in A4, 1, 1 , 1 , and 3. The expec- 
tation values in each of the one-dimensional irreducible representations is either 
zero or not zero. In either case it is easy to write down a potential that produces 
the result. Thus, assuming the potentials of different irreducible representations do 
not interact, the difficult ones are those involving multi-dimensional representations 
such as 3. 

For 3, the solution must be either (0,0,0), or (1,0,0) which is the invariant eigen- 
vector of F = F3, or (1,0, 2 ) which is the invariant eigenvector of G' 1: or (1,1,1) 
which is the invariant eigenvector of G2, or (1,0 2 ,0) which is the invariant eigen- 
vector of G3, or one of their equivalents. 

Is there a generic potential of 3 that has exactly these solutions? The answer is 
'yes', because a generic U(l) x A 4 potential does indeed have these properties.^ 

This potential also tells us that the TBM mixing matrix (TT|) obtained as a partial 
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mixing of A4 is energetically more favorable than the full mixing 
3.3. (7(1) X SO(3) dynamics 

Both Q = S4 and A4 are capable of producing TBM, so is the horizontal symmetry 
of leptons S*4, A4, or something else? Since both of them are subgroups of 50(3), 
one might hope to use the dynamics of 50(3) to see which of these finite subgroups 
is 50(3) going to break down to, thereby picking out the preferred horizontal sym- 
metry for leptons. Unfortunately, it is knowrPthat no matter what the dynamics is, 
as long as the valons have an 50(3) spin less than 3, neither 54 nor A4 symmetry 
can be retained after the breakdown. We want valons to have spins less or equal to 
2 because they couple to two fermions, and being a triplet each fermion can have a 
horizontal spin of at most 1 . 

However, a generic U(l) x 50(3) valon potential can fulfill this mission. De- 
pending on the relative strengths of coupling constants, it breaks into one of three 
possible phases, one of which carries an A4 symmetry suitable for lepton mixing. 
No phase containing any other non-abelian symmetry such as 54 exists. The other 
two phases produce block-diagonal and hierarchical mass matrices that are capable 
of describing mass hierarchy and Cabibbo mixing of quarks™ Thus this higher sym- 
metry U(l) x 50(3) not only picks out A4 over 54, it also serves as an approximate 
common symmetry for quarks and leptons at some high energy scale. 
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